
ADAPTIVE AND LEARNING 
SETTING SELECTION PROCESS 
WITH SELECTABLE LEARNING MODES 
FOR IMAGING DEVICE 
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The present invention relates generally to the field 
of imaging, and more particularly, to an adaptive and 
learning process for selecting settings in an imaging 
device . 



Nearly all modern imaging devices have multiple 
settings which are controlled electronically. Purely 
mechanical controls in imaging devices have become 
extremely rare. Electronic settings controls in imaging 
devices provide much greater ease of use and improved 
image quality for the amateur user, since they can be 
preprogrammed for a number of different environments. 
For example, most modern cameras, whether film or digital 
cameras, have several modes with preprogrammed settings, 
such as for low light nighttime photography or for high 
speed sports photography. In each mode settings for 
exposure time, f-stop, etc are predetermined and 
programmed into the camera. These preprogrammed modes 
allow the user to take reasonably good pictures in a 
number of general types of environments. 

In addition, many imaging devices allow the user to 
manually adjust one or more of the settings in order to 
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deviate from the preprogrammed modes and settings. This 
allows the more experienced user to increase the quality 
of the images when none of the preprogrammed modes are 
well suited to the environment. In fact, with the 
5 unlimited variation in environment and the small number 
of preprogrammed modes in most imaging devices, it is 
unlikely that a preprogrammed mode will provide the best 
possible image quality. Furthermore, user's tastes in 
images vary widely, making it difficult or impossible to 
10 program settings which will most please every user. 



As digital imaging devices have become increasingly 
popular, the problem is exacerbated, since digital 
cameras typically have more settings to adjust than film 
15 cameras. For example, digital imaging devices have a 
white balance setting, which is used to prevent color 
shifts, ensuring that white objects actually appear 
white. Thus, even though the number of preprogrammed 
modes may remain the same in digital cameras as in film 
20 cameras, the number of settings to be programmed for each 
Cj mode is greater. This further decreases the likelihood 

that the preprogrammed settings will provide the 
preferred image for every user in a given environment. 

25 Digital cameras are well known in the art and 

various components thereof are described in US Patent 
4,131,919, US Patent 4,420,773, and US Patent 4,541,010, 
all of which are hereby incorporated by reference for all 
that they disclose. 
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Digital cameras require a high level of interaction 
with the user. There are a large number of settings that 
may be adjusted to optimize and personalize the resulting 
image quality. However, the process of adjusting the 
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settings can be cumbersome and confusing to the user. 
The typical user may not understand many of the settings 
and how they affect the picture. In addition, the user 
usually needs settings optimized for only a few 
situations, and may be satisfied with the preprogrammed 
modes in other environments. 

A need therefore exists for a method of adjusting 
settings in an imaging device which solves some or all of 
the above problems. 



Summary 

To assist in achieving the aforementioned needs, the 
inventors have devised an adaptive and learning setting 
selection method for imaging devices. This causes an 
imaging device to adapt to user preference over time. As 
the user adjusts settings in the imaging device, the new 
settings are combined with previous settings as points in 
settings space, forming a cluster of points. The camera 
then finds the optimal point in the cluster and uses the 
point to set camera options. Each mode in the camera 
thus develops a cluster of points in settings space, so 
that the optimal point changes as user preferences 
change. In addition, new modes may be formed in the 
camera when user settings differ to a large degree from 
settings in any predefined mode. 

The invention may comprise a method of configuring 
settings in an imaging device. The method includes 
configuring the settings with default values. If at 
least one value for the settings is externally adjusted, 
the settings in the imaging device are configured with 
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the at least one value. If the user indicates that the 
new settings are acceptable, the imaging device 
determines whether to store the new settings for use in 
calculating new default values. 

5 

The invention may also comprise an electronic 
imaging device having an imaging system and computer 
readable program code. The computer readable program 
code includes code for retrieving a default state of a 

10 plurality of settings in the imaging device, and code for 
configuring the imaging device with the default state of 
the plurality of settings. The computer readable program 
code also includes code for reading a new state of the 
plurality of settings after an image is captured, code 

15 for retrieving at least one previous state of the 

plurality of settings, and code for calculating a new 
default state for the plurality of settings from the new 
state and the at least one previous state of the 
plurality of settings. 
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The invention may also comprise a digital imaging 
apparatus having means for configuring the digital 
imaging apparatus with default settings, means for 
reading new settings on the digital imaging apparatus, 
25 means for determining whether to calculate new default 

settings, and means for calculating new default settings. 



Brief Description of the Drawing 

30 

Illustrative and presently preferred embodiments of 
the invention are shown in the drawing, in which: 

FIG. 1 is a perspective front view of a digital 
cameras- 
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FIG. 2 is a perspective rear view of the digital 
camera of FIG. 1; 

FIG. 3 is a diagram illustrating the hierarchy of 
modes and settings in an imaging device; 

FIG. 4 is a flow chart illustrating a basic adaptive 
and learning setting selection process in an imaging 
device ; 

FIG. 5 is a graph of a two-dimensional settings 
space having multiple clusters made up of settings 
points ; 

FIG. 6 is a flow chart illustrating the process of 
locating an optimal point representing a cluster; 

FIG. 7 is a flow chart illustrating the creation and 
maintenance of settings clusters in the case that the 
optimal point of a cluster is at the cluster's arithmetic 
mean; 

FIG. 8 is a flow chart illustrating a preferred 
adaptive and learning setting selection process in an 
imaging device which employs a cluster of previous 
settings to calculate optimal settings; 

FIG. 9 is a flow chart illustrating an alternate 
preferred adaptive and learning setting selection process 
in an imaging device in which multiple previous settings 
are accumulated to calculate optimal settings; and 

FIG. 10 is a flow chart illustrating an adaptive and 
learning settings selection process in an imaging device 
which combines the previous optimal settings with the 
current settings to calculate the new optimal settings. 

Description of the Preferred Embodiment. 

The drawing and description, in general, disclose a 
method of configuring settings in an imaging device. The 
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method includes configuring the settings with default 
values. If at least one value for the settings is 
externally adjusted, the settings in the imaging device 
are configured with the at least one value. If the user 
5 indicates that the new settings are acceptable, the 
imaging device determines whether to store the new 
settings for use in calculating new default values. 



The drawing and description also disclose an 
10 electronic imaging device having an imaging system and 
computer readable program code. The computer readable 
program code includes code for retrieving a default state 
of a plurality of settings in the imaging device, and 
code for configuring the imaging device with the default 
15 state of the plurality of settings. The computer 

readable program code also includes code for reading a 
new state of the plurality of settings after an image is 
captured, code for retrieving at least one previous state 
of the plurality of settings, and code for calculating a 
20 new default state for the plurality of settings from the 
new state and the at least one previous state of the 
plurality of settings. 



The drawing and description also disclose a digital 
25 imaging apparatus having means for configuring the 

digital imaging apparatus with default settings, means 
for reading new settings on the digital imaging 
apparatus, means for determining whether to calculate new 
default settings, and means for calculating new default 
30 settings. 

An adaptive and learning setting selection process 
may be included in any imaging device having at least one 
user adjustable setting, such as exposure time or 
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aperture. The adaptive and learning setting selection 
process enables the imaging device to track or follow 
user preferences for these settings. Each time the user 
makes adjustments to the settings in the imaging device, 
5 the new values are accumulated so that the imaging device 
can learn and adapt to the user preferences. The imaging 
device then combines new user adjusted settings with 
accumulated previous settings to calculate optimal 
settings for the user. The imaging device is then 
10 configured according to the optimal settings. 

£5 For imaging devices having multiple modes, the 

accumulated values are stored according to the current 

1=, mode. For example, an imaging device may have a sports 

15 mode and a normal mode, where the sports mode has a lower 

fn exposure time than the normal mode in order to capture 

'=^' high speed activities without motion blur. User adjusted 

settings are associated with a particular mode, so that 
each mode tracks user preferences for a certain 

{\\ 20 environment. 

The adaptive and learning setting selection process 
in an imaging device provides great benefits such as 
simplifying use and improving image quality for a given 

25 user. With the adaptive and learning setting selection 
process, the imaging device learns as the user adjusts 
settings. The imaging device thus becomes personalized, 
creating images which correspond much more closely to 
user preferences than those created with static, 

30 preprogrammed settings. The adaptive and learning 

setting selection process can also create new modes on 
the imaging device when the user adjusted settings differ 
greatly from settings in existing modes. For example, an 
imaging device may be preprogrammed with a sports mode 
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for high speed imaging. If the user changes settings to 
create images of winter sports activities having a 
brilliant snowy background, the adaptive and learning 
setting selection process may create a new mode to 
5 capture high speed images that are not overexposed and 
washed out . 

The adaptive and learning setting selection process 
also greatly simplifies adjustment of settings in the 
10 imaging device. The settings in the imaging device are 
defaulted to previous optimal settings based on user 
preferences. Therefore, the user will typically have 
'^3 fewer changes to make in a new environment than if the 

l2 settings were preprogrammed to a factory default. 

ru 15 

£rl The adaptive and learning setting selection process 

may also simplify settings selection by presenting a 

Li, group of sample images, each created with different 

possible settings. The user may then simply select the 

ij 20 preferred image, rather than blindly adjusting settings 
manually. Typical users do not fully understand the 
settings and how they affect resulting images in a given 
imaging device without a great deal of practice. By 
presenting sample images, the adaptive and learning 
25 setting selection process allows the user to adjust 
settings much more easily. 

Typical types of imaging devices which may benefit 
from the adaptive and learning setting selection process 
30 include digital cameras 10 (FIG. 1) . Digital cameras 10 
are well-known in the art and are analogous to ordinary 
film-type cameras, except that the film is replaced with 
a photoelectric detector (e.g., a charge-coupled device 
(CCD) ) . The photoelectric detector converts the light 
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received by the camera into electronic signals, which may 
be digitized and stored as digital image data. For 
example, the resulting digital image data may be stored 
in an electronic memory system, such as random access 
memory (RAM) , or may be stored on a magnetic or optical 
disk of the type commonly used to store digital data. 

Digital cameras 10 offer considerable advantages 
over conventional film-type cameras in that the digital 
image data may be stored, processed, and/or reproduced 
with ease. The relative ease of handling and processing 
the digital image data produced by digital cameras allows 
users to readily enlarge, reduce, crop, or otherwise 
modify the digital image data to create any of a wide 
range of photographic effects and styles, as well as to 
easily capture the image of a document and convert text 
in the image to a text file. 

Before describing the adaptive and learning setting 
selection process in more detail, an exemplary digital 
camera 10 which may employ the adaptive and learning 
setting selection process will be described. However, it 
is important to note that the adaptive and learning 
setting selection process is not limited to any 
particular type of imaging device. For example, the 
imaging device may also comprise a scanner. 

A digital camera 10 (FIGS. 1 and 2) includes an 
optical imaging assembly to convert image light to 
electronic image data, a storage device to store the 
image data, and a control system, all contained in a 
housing 14. The control system provides a user 
interface, controls the optical imaging assembly, and 
processes and formats the image data. The control system 
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also implements the adaptive and learning setting 
selection process by accepting user adjusted settings, 
accumulating previous settings, calculating optimal 
settings and configuring the optical imaging assembly 
5 according to the optimal settings. A lens 20 in the 

optical imaging assembly is located in the housing 14 to 
allow light to enter the digital camera 10. Control 
buttons, such as a shutter control button 12 and 
navigation buttons 24, 26, 30, and 32, are provided on 
10 the outside of the housing 14. The digital camera 10 
preferably includes an illumination system such as a 
12- flash 16 mounted on the outside of the housing 14. A 

J=i display device 22 is also located on the outside of the 

1=^ housing 14. The digital camera 10 also includes a power 

15 source such as a battery. Each of the foregoing systems 
iQ and devices will now be described in detail. 

= 

|ir The housing 14 of the digital camera 10 comprises a 

l2 generally rectangularly shaped structure sized to receive 

%u 20 the various internal components of the camera 10. The 
:z housing 14 is sized to receive the optical imaging 

assembly, which includes a lens 20 and an electrical 
photodetector . The lens 20 is preferably telecentric or 
near telecentric. The photodetector detects image light 
25 focused thereon by the lens 20 and comprises a CCD, 
although other devices may be used. A typical CCD 
comprises an array of individual cells or "pixels," each 
of which collects or builds-up an electrical charge in 
response to exposure to light. Since the quantity of the 
30 accumulated electrical charge in any given cell or pixel 
is related to the intensity and duration of the light 
exposure, a CCD may be used to detect light and dark 
spots on an image focused thereon. 
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The term ''"image light" as used herein refers to the 
light that is focused onto the surface of the detector 
array by the lens 20. The image light may be converted 
into digital signals in essentially three steps. First, 
5 each pixel in the CCD detector converts the light it 

receives into an electric charge. Second, the charges 
from the pixels are converted into analog voltages by an 
analog amplifier. Finally, the analog voltages are 
digitized by an analog-to-digital (A/D) converter. The 
10 digital data then may be processed and/or stored as 
desired. 

-= 3j 

^3 The storage device in the digital camera 10 stores 

lL the image data collected by the optical imaging assembly. 

15 The storage device preferably comprises a random access 
Iq memory (RAM), or may comprise a magnetic, optical, or 

^= other solid state storage medium. 

The control system in the digital camera 10 provides 
lij 20 a user interface, controls the optical imaging assembly, 
'l£ and processes and formats the image data, either before 

or after storage in the storage device. The control 
system also implements the adaptive and learning setting 
selection process. The control system preferably 
25 comprises a microprocessor and associated memory. 

Alternatively, the control system may comprise a hard- 
coded device such as an application specific integrated 
circuit (ASIC) . 

30 The display device 22 in the digital camera 10 is a 

liquid crystal display (LCD) or any other suitable 
display device. The digital camera 10 also includes 
other components, such as a battery system. However, 
since digital cameras are well-known in the art and could 
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be easily provided by persons having ordinary skill in 
the art after having become familiar with the teachings 
of the present invention, the various systems and devices 
of a digital camera 10 that may be utilized in one 
5 preferred embodiment of the present invention will not be 
described in further detail herein. 

During operation of the digital camera 10, the 
camera 10 is oriented with the lens 20 directed at a 
subject. The mode is selected and the settings are 
adjusted as desired by the user. The mode and settings 
are adjusted with the navigation buttons 24, 26, 30, and 
32 or by any other suitable means, such as with a 
computer attached to the digital camera 10. The adaptive 
and learning setting selection process then calculates 
optimal settings and configures the digital camera 10 
with the optimal settings, as will be described in 
greater detail hereinafter. (The optimal settings may be 
overridden by the user if desired.) The subject may be 
monitored either through a viewfinder (not shown) or on 
the display panel 22. When the digital camera 10 is 
properly oriented, the shutter control button 12 is 
pressed. The photodetector converts the image light 
directed thereon by the lens 20 into electrical image 
data, which are stored in the storage device. The 
control system then processes the image data and displays 
the captured image on the display panel 22. 

Before continuing with the description of the 
30 adaptive and learning setting selection process, the 

relationship between modes and settings will be defined. 
The mode is a configurable state of the imaging device 
which is chosen according to the subject characteristics, 
such as brightness and speed of movement. Settings are 
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used to control each adjustable parameters of the imaging 
device, such as aperture size and exposure time. For 
each mode, the settings are configured with values which 
produce an acceptable image given the subject 
5 characteristics. The hierarchy of modes (e.g., 40 and 
42) and settings (e.g., 44-50, 52-56) in the digital 
camera 10 is illustrated in FIG. 3. Each mode 40 and 42, 
such as low light and sports, respectively, contains a 
group of settings 44-50 and 52-56. Exemplary settings in 

10 the digital camera 10 include exposure time 44 and 52, 
aperture 46 and 54, and ISO speed 50 and 56. For 
example, if the digital camera 10 is in the low light 
mode 40 shown in FIG. 3, the exposure time setting 44 is 
^ second, the aperture setting 46 is f2.8, and the ISO 

15 speed setting 50 is 400. If the digital camera 10 is in 
the sports mode 42, the exposure time setting 52 is 1/800 
second, the aperture setting 54 is fll, and the ISO speed 
setting 56 is 100. 

20 Settings may be adjusted in several ways according 

to the adaptive and learning setting selection process. 
Settings may be entered by the user directly on the 
digital camera 10, e.g., by pressing the control buttons 
24-32. Settings may also be entered on a computer which 

25 transmits the settings values to the digital camera 10. 

Alternatively, settings may be adjusted by 
presenting sample images to the user, one of which is 
chosen as having the preferred image characteristics. In 
30 this case, a set of sample images is prepared, preferably 
all having the same subject matter. Each of the sample 
images is prepared to illustrate the effects of different 
settings values. For example, a set of three sample 
images may be prepared having three different exposure 
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times. The user would then choose one of the three 
sample images, and the exposure setting on the digital 
camera 10 would be set to the exposure setting used to 
prepare the chosen sample image. The sample images may 
5 be displayed in any suitable manner, such as 

simultaneously or one after the other. The sample images 
may be displayed on the display panel 22, on a remote 
computer screen, or on a printed page. 



10 Referring now to FIG. 4, an overview of the adaptive 

and learning setting selection process in operation in 

f5 the digital camera 10 will be given. As a mode is 

2": selected 70, a group of previous settings are retrieved 

1=:^ 72 for that mode. Optimal settings are calculated 74 to 

f ij 

;^ 15 represent the group of previous settings. The digital 
Cg camera 10 is then configured 7 6 according to the 

retrieved previous optimal settings. If the user 
== manually adjusts 82 some of the settings, the new 

[~ settings are combined 84 with the previous settings to 

iy 20 and new optimal settings are calculated based on the 

combined new and previous settings. The digital camera 
10 is then reconfigured 76 with the new optimal settings. 
Thus, each time the user manually adjusts 82 settings on 
the digital camera 10, the camera 10 is learning the 
25 preferences of the user. Over time, user adjusted 

settings are combined or averaged to focus in on user 
preferences. The user may take a picture 80 at any time 
after the camera is configured 76 with the optimal 
settings, whether new manually adjusted settings have 
30 been entered 82 or not. 



Note that one or more settings may remain automatic 
in the digital camera 10, or all may be manually set. 
For example, the exposure time setting is often automatic 
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in imaging devices, subject to an internal light meter. 
In this case, it may be desirable to exclude the 
automatic settings from the adaptive and learning setting 
selection process. In other words, automatic settings 
would not be included in the calculation for optimal 
settings. However, under some conditions, such as in a 
portrait studio, the lighting is controlled and the user 
may wish to manually control all settings in a digital 
camera 10, including exposure time. In this case, all 
settings would be included in the adaptive and learning 
setting selection process. 

Note also that the digital camera 10 may be provided 
with an entirely manual mode, in which the adaptive and 
learning setting selection process is overridden and 
manually adjusted settings are directly used to configure 
the digital camera 10, rather than calculating and using 
optimal settings . 

Three preferred embodiments of the adaptive and 
learning setting selection process will now be discussed. 
In the first, multiple previous states are accumulated in 
the digital camera 10 (see FIGS. 5-8), and the digital 
camera 10 is configured with optimal settings as soon as 
they are calculated. In the second, multiple previous 
states are accumulated in the digital camera 10 (see 
FIGS. 5-8), and the digital camera 10 is configured with 
optimal settings after a mode change or the digital 
camera 10 is again turned on. In the third, only the 
most recent previous state is kept (see FIG. 9) . 

The first preferred embodiment of the adaptive and 
learning setting selection process will now be described. 
In this embodiment, the digital camera 10 accumulates 
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previous settings as points in a settings space. The 
settings space is a multidimensional space in which each 
dimension in the settings space is defined by one of the 
settings in the digital camera 10. Points in settings 
5 space are preferably grouped in clusters according to 
different modes on the digital camera 10. 

An exemplary settings space 100 is illustrated in 
FIG. 5. In this example, the digital camera 10 has two 

10 settings which are included in the adaptive and learning 
setting selection process. Each different state of the 
two settings in the digital camera 10 may be represented 
as a point in a two dimensional settings space 100. The 
settings space 100 is illustrated in a graph in which the 

15 first axis 102 represents the first setting and the 
second axis 104 represents the second setting. {For 
example, the two settings could be exposure time and 
aperture setting.) 

20 The settings space 100 is bounded on four sides 106, 

108, 110, and 112. The position of the boundary is 
determined by the acceptable range of settings in the 
digital camera 10. The top boundary 106 and bottom 
boundary 112 are established by the upper and lower 

25 limits, respectively, of the first setting. The left 
boundary 108 and right boundary 110 are established by 
the upper and lower limits, respectively, of the second 
setting . 

30 In this example, the digital camera 10 has two 

modes, each having a cluster 114 and 120 of points (e.g., 
124 and 140) . The first cluster 114 of points is 
associated with the first mode, and the second cluster 
120 of points is associated with the second mode. That 
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is, the points in the first cluster 114 were stored while 
the digital camera 10 was in the first mode, with only 
small manual adjustments were made to the settings. The 
points in the second cluster 120 were stored while the 
digital camera 10 was in the second mode, with only small 
manual adjustments made to the settings. The digital 
camera 10 is preferably preprogrammed with a settings 
point for each mode by the manufacturer. This allows the 
digital camera 10 to be configured with suitable initial 
settings in each mode, before the adaptive and learning 
setting selection process personalizes the digital camera 
10 according to user preferences. 

The optimal point of a cluster is used to find the 
best representation of a users preferences. As the user 
manually adjusts settings, adding settings points to a 
cluster, the cluster will become increasingly dense with 
points and the optimal point in the cluster will become 
an increasingly good representation of the users 
preferences. The optimal point of a cluster is 
preferably the arithmetic mean of the cluster, as this 
calculation can be done rapidly by a simple processor. 
Alternatively, other algorithms for calculating an 
optimal point to represent a cluster may be used. For 
example, the median may be used, which is less sensitive 
to outlying settings points in a cluster than the mean, 
although it is not as simple to calculate. 

The process for finding the optimal point of a 
cluster as the arithmetic mean is illustrated in the flow 
chart of FIG. 6. The arithmetic mean is the average of 
the settings points in the cluster. Each coordinate of 
each settings point in the cluster is averaged, and the 
resulting averaged coordinates combine to form the 
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location of the optimal point. This process may be 
accomplished by first setting 220 a variable i to 1 . The 
i'th coordinate of each point in the cluster is retrieved 
222 and summed 224. The sum is divided 226 by the number 
5 of points in the cluster to produce the i'th coordinate 
of the mean point. If points in the cluster have more 
than i coordinates 230, then i is incremented 232, and 
the process is repeated starting by retrieving 222 the 
new i'th coordinates. Once all the coordinates of the 
10 mean point are calculated, they are grouped 234 to form 
the location of the optimal point. 



For example, referring to FIG. 5, the first cluster 
114 consists of seven settings points, point 124 at 

15 (15,13), point 126 at (14,10), point 128 at (17,11), 

point 130 at (19,11), point 132 at (17,9), point 134 at 
(20,9), and point 136 at (17,7). Note that the values 
and units shown here are arbitrary and are normally based 
on the actual settings in a digital camera 10. They may 

20 be represented as an 8-bit digital number from 0 to 255, 
or as a set of acceptable settings values such as f-stop 
numbers, or in any other suitable manner. To calculate 
the location of the optimal point 116 in the first 
cluster 114, the first coordinates of each settings point 

25 in the cluster are summed, then divided by the number of 
points in the cluster: (15 + 14 + 17 + 19 + 17 + 20 + 17) 
/ 7 = 17. The second coordinates of each settings point 
in the cluster are then summed and divided by the number 
of points in the cluster: (13 +10+11+11+9+9+7) 

30 / 7 == 10. The resulting coordinates are then grouped as 
the location of the optimal point 116: (17,10). Note 
that the coordinates of the optimal point may need to be 
rounded to the nearest acceptable settings value for the 
digital camera 10. 



HP: 10007731-1 




-19- 

Similarly, the second cluster 120 consists of six 
settings points, point 140 at (3,8), point 142 at (4,5), 
point 144 at (5,4), point 146 at (4,3), point 150 at 
(2,2), and point 152 at (6,2). The first coordinates of 
5 each settings point in the cluster are summed, then 

divided by the number of points in the cluster: (3 + 4 + 
5+4+2+6) /6=4. The second coordinates of each 
settings point in the cluster are then summed and divided 
by the number of points in the cluster: (8+5+4+3+ 
10 2 + 2) / 6 ^ 4. The resulting coordinates are then 

grouped as the location of the optimal point 122: (4,4). 

The settings space is not limited to the two 
dimensional example described herein. In practice, a 
15 multidimensional settings space includes one dimension 

for each setting on the digital camera 10 which is to be 
included in the adaptive and learning setting selection 
process . 

20 Points (e.g., 124 and 140) in settings space 100 may 

be clustered, or arranged into clusters, in any suitable 
fashion. A number of suitable mathematically intensive 
but effective clustering algorithms are well known. The 
preferred method, and perhaps the simplest, is to 

25 preprogram an initial point in each cluster as mentioned 
above. Thereafter, a new point is included in a cluster 
if it is within a predetermined threshold distance 156 of 
the optimal point in a cluster. For example, the point 
126 is within the threshold distance 156 from the optimal 

30 point 116 of the first cluster 114, but outside the 

threshold distance 156 from the optimal point 122 of the 
second cluster 120. Therefore, the point 126 will be 
stored with the first cluster 114. 
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The point 154 is outside the threshold distance of 
both clusters 114 and 120, so a new cluster and mode will 
be created containing the point 154. Note that this 
means that if the digital camera 10 is placed into a 
certain mode and the settings are drastically manually 
adjusted, the mode may be changed or a new mode can be 
created based on the new settings. 

If a new settings point is within the threshold 
distance of the optimal point of more than one cluster, 
it is included in the closest cluster. 

Note also that the boundary of a cluster (e.g., 
114), defined by the threshold distance 156 from the 
optimal point (e.g., 116), may fall in part outside of 
the settings space 100 if the optimal point 116 is close 
enough to one or more boundaries (e.g., 106) of the 
settings space. For example, a portion of the boundary 
of the first cluster 114 includes a region 118 outside 
the settings space 100. However, since no settings 
points outside the settings space 100 can be entered on 
the digital camera 10, no points will fall in regions 118 
inside clusters but outside the settings space. 

Referring now to FIG. 7, this preferred clustering 
process will be summarized, for the embodiment in which 
the optimal point is at the arithmetic mean of a cluster. 
A new settings point is first obtained 170 when the user 
manually adjusts settings in the digital camera 10. The 
distance between the new settings point and the mean 
point in each cluster is then calculated 172. The 
algorithm used to calculate distance depends upon the 
number of dimensions in settings space, and the chosen 
geometry of the settings space. Suitable algorithms for 
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calculating distance in different types of 

multidimensional space are well known, such as the square 
root of the sum of the squares to calculate distance in a 
Cartesian coordinate system (((x2-xl)'^2 + (y2-yl)'^2 + 
5 (Z2-Z1) ^^2) '^ii) . 

The cluster with the nearest mean point to the new 
settings point is selected 174, and the distance to this 
nearest mean point is compared 17 6 with the predetermined 
10 threshold distance. If the new settings point is within 
the threshold distance, the new settings point is stored 
180 with the cluster, and the new arithmetic mean of the 
li cluster is calculated and stored 182. If the distance 

between the new settings point and the nearest mean point 
15 is greater than the threshold distance, a new cluster is 
CS created 184 containing the new settings point, and the 

arithmetic mean of the new cluster is stored 186. (In 
1=:^= this case, with only one point, the arithmetic mean is at 

TT the same location as the new settings point.) 

Id 20 

Zz Calculating and storing the arithmetic mean for a 

cluster when adding a new settings point speeds up later 
operations by avoiding the need to recalculate the mean 
over and over when changing modes on the digital camera 
25 10 or when adding later settings points. 

The number of previous settings states, or points, 
which are accumulated in the preferred embodiment may be 
limited by the available memory in the digital camera 10 
30 or may be limited to a predetermined number to simplify 
clustering calculations. 

The adaptive and learning setting selection process 
for the preferred embodiment in which multiple settings 
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points are accumulated in clusters will now be summarized 
(see FIG. 8) . As the user selects a mode 200, the 
cluster of settings points associated with that mode is 
identified 202. The optimal point representing the 
5 cluster is retrieved 204 if it was previously stored, 
otherwise it is calculated. The digital camera 10 is 
configured 206 with the settings represented by the 
optimal point. The user may take a picture 208 with the 
optimal settings at this point. If the user elects to 
10 manually adjust settings, a new point in settings space 
is formed 210 based upon the manually adjusted settings. 
^=1 The nearest cluster to the new point is identified or 

^3 created, as described above with respect to FIG. 7, and 

l2 the new point is stored 212 with the cluster. If the 

[■^ 15 cluster is not the same as the beginning cluster of the 
fg second step 202, the mode on the digital camera 10 is 

changed. If the cluster is a new one, the user may be 
prompted to enter a name for a new mode associated with 
the new cluster. The optimal point representing the 
I J 20 updated cluster having the new point is calculated 214, 
and the digital camera 10 is again configured 206 with 
settings represented by the optimal point. 

The second preferred embodiment of the adaptive and 
25 learning setting selection process will now be discussed 
(see FIG. 10) . In this embodiment, multiple settings 
points are accumulated, from which optimal settings are 
calculated. The digital camera 10 utilizing the adaptive 
and learning setting selection process is not immediately 
30 configured with the optimal settings when they are 
calculated. Rather, when a user manually adjusts 
settings in the digital camera 10 the optimal settings 
are calculated, but the digital camera 10 remains 
configured with the manual settings. The digital camera 
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10 is not configured with the new optimal settings until 
default settings are needed, such as when the mode is 
changed or when the digital camera is turned off and on 
again . 

In this embodiment, manually adjusted settings are 
also not automatically stored. The digital camera 10 has 
three accumulation modes which determine whether new 
manual settings are stored or accumulated. In the first, 
new manually adjusted settings are automatically stored. 
In the second, new manually adjusted settings are 
automatically discarded. In the third, the digital 
camera 10 prompts the user to indicate whether to store 
or discard the new manually adjusted settings. 

This process is illustrated in FIG. 10. The user 
first selects 216 a mode, or turns on the digital camera 
10 making it default to a mode. The stored settings 
associated with the mode are retrieved 218, and the 
optimum settings representing the stored settings are 
calculated 220. The digital camera 10 is configured 222 
with the optimal settings, and the user may take 224 a 
picture. If the user manually adjusts 226 one or more 
settings, the digital camera 10 remains configured with 
the new manually adjusted settings, and the user may take 
228 a picture. Taking 228 the picture triggers the 
digital camera 10 to continue with the settings storage 
process, so that the user can continue to manually adjust 
settings without storing settings before the adjustment 
process is complete. 

The accumulation mode is checked 230 to determine 
whether to store the new manually adjusted settings. If 
the digital camera 10 is in Discard mode, the manually 
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adjusted settings are discarded 232. In other words, the 
manually adjusted settings are not stored, even though 
the digital camera 10 remains configured with them until 
the mode is changed, the digital camera 10 is turned off, 
5 or new manually adjusted settings are entered. If the 
digital camera 10 is in Add mode, the new manually 
adjusted settings are stored 234 with previous settings. 
If the digital camera 10 is in Prompt mode, the user is 
prompted 236 to indicate whether to store or discard the 
10 new settings. If the user indicates 238 that settings 

should be stored, the new manually adjusted settings are 
£3 stored 234 with previous settings. If not, the new 

manually adjusted settings are discarded 232. 

I't 15 The third preferred embodiment of the adaptive and 

CQ learning setting selection process, in which only the 

I' most recent previous state is kept, will now be discussed 

H (see FIG. 10) . In this embodiment, the digital camera 10 

=!^^ stores only one default settings state for each mode, 

iy 20 The default settings may be thought of as a point in 
}% settings space, as described above, or simply as a state 

of the settings. In either case, the calculations and 
results are the same. The digital camera 10 is 
configured with the default settings when turned on or 
25 when a mode is selected. New settings are combined with 
the default settings and the resulting settings are 
stored over the default settings. As a result, the 
default settings move over time to follow the user 
preferences. Each time new settings are to be combined 
30 with the existing default settings, new default settings 
are calculated which lie somewhere between the existing 
default settings and the new settings. For example, the 
existing default and new settings may be averaged, or the 
new default settings may lie between the existing default 
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and new settings at a predetermined percentage of the 
distance between the two, such as at 30% of the distance 
from the existing default settings to the new settings. 

5 This process is illustrated in the flow chart of 

FIG. 10. The user first selects 240 a mode, and the 
existing default settings state is retrieved 242. The 
digital camera 10 is configured 244 with the settings in 
the default settings state, and the user may take a 

10 picture 246 with the default settings. If the user 

adjusts the settings, the new manually adjusted settings 
are combined 250 with the existing default settings to 
form a new default settings state. The new default 
settings state is stored 252 over the previous default 

15 settings state. The digital camera 10 may be 

reconfigured 244 immediately with settings in the new 
default settings state. Alternatively, the digital 
camera 10 may be configured with the settings in the new 
default settings state after the mode is changed or the 

20 next time the digital camera 10 is turned on. This 

embodiment is especially well suited for imaging devices 
having a strong mode of preference rather than several 
distinct modes. 

25 Aspects of an adaptive and learning setting 

selection process are also described in U.S. Patent 
application entitled "ADAPTIVE AND LEARNING SETTING 
SELECTION PROCESS FOR IMAGING DEVICE" (Attorney Docket 
No. 10992521-1) of Daniel M. Esquibel, et al., filed 

30 concurrently herewith and which is incorporated herein by 
reference for all that it discloses. 

While illustrative and presently preferred 
embodiments of the invention have been described in 
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detail herein, it is to be understood that the inventive 
concepts may be otherwise variously embodied and 
employed, and that the appended claims are intended to be 
construed to include such variations, except as limited 
by the prior art. 
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